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IMAGE GENERATING SYSTEM 



Background of the Invention 



1. Field of the Invention 

The present invention relates to three dimensional computer 
graphics (CG), and, in particular, to an image generating system for 
displaying a three dimensional (3D) model in a eel animation style. 

2. Related Art Statement 

Owing to the recent improvement in hardware performance, 
even a consumer video game machine can generate images of three 
dimensional CG (Computer Graphics) in real time, realizing a three 
dimensional CG animation. 

Further, according to contents of a game or the like, it is 
sometimes desired to display such a three dimensional CG animation in 
a conventional eel animation style. In a eel animation, an image is 
generated by drawing lines and painting the inside of each drawing, 
and, as a result, a character or the like has contours* However, 
according to ordinary three dimensional CG, contours are not drawn. 
Thus, to realize display in a eel animation style, contours should be 
drawn in a 3D modeL 

A 3D model is made of, for exaxnple, a plurality of surfaces. 
To draw contours in such a 3D model, it is necessary to draw a line 
between specific surfaces, namely between a surface that faces the front 
side and a surface that faces the back side, seen from a viewpoint. 

Summary of the Invention 
However, the above-mentioned method first requires 
information on connection between surfaces, and further it is required 
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to check if a side shared between the adjacent surfaces is a side where a 
contour should be drawn, based on the information on the connection 
between those surfaces. 

Accordingly, when the number of polygons becomes larger, 
5. more calculations are required that the calculations can not be 
processed in real time, 

An object of the present invention is to provide an image 
generating system that displays contours at high speed, and 
accordingly, can realize eel animation style display. 

10 The present invention provides an image generating system, 

comprising; a surface direction judging means for judging a direction of 
a surface constituting a three dimensional model, in relation to a 
viewpoint; and a contour generating means for shifting an original 
surface that faces a back side in relation to the viewpoint, in a direction 

15 of a normal/ and for painting the shifted surface with a color that is 
darker than a color of the original surface. 

Further, the present invention provides a method of generating 
an image, comprising steps of; judging a direction of a surface 
constituting a three dimensional model, in relation to a viewpoint; and 

20 shifting an original surface that faces a back side in relation to the 
viewpoint, in a direction of a normal, and painting the shifted surface 
with a color that is darker than a color of the original surface. 

Further, the present invention provides a storage medium that 
stores an image generating program, and that program causes execution 

25 of steps of; judging a direction of a surface constituting a three 
dimensional model, in relation to a viewpoint; and shifting an original 
surface that faces a back side in relation to the viewpoint, in a direction 
of a normal, and painting the shifted surface with a color that is darker 
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than a color of the original surface. 

In the above-mentioned cases, the shifted surface may be 
generated with a different quantity of shift or a different color for each 
three dimensional model. And, for example, the shifted surface may 
be generated with a smaller quantity of shift and with a color closer to 
the color of the original surface, as the three dimensional model exists 
more distantly from a screen. 

The above-mentioned program may be distributed by a portable 
storage medium such as a CD-ROM, a DVD-ROM, a memory card, etc. 
or through a network. 

Brief Description of the Drawings 

Fig. 1 is a block diagram showing a configuration of an 
entertainment apparatus to which the present invention is applied; 

Fig. 2 is a diagram showing internal structure of a graphics 
processor 110; 

Fig. 3 is a diagram showing structure of a local memory 220; 
Fig. 4 is a view showing an example of a 3D model; 
Fig. 5 is a table showing data structure of the 3D model; 
Fig. 6 is a view showing a state of respective normal vectors at 
vertices of the 3D model; 

Fig. 7 is a view showing a state in which surfaces facing the 
back side are shifted in the directions of the normals; 

Fig. 8 is a view showing a state in which shifted surface are 
painted with a darker color; 

Figs. 9 A and 9B are views showing how thicknesses of the 
contours change according to the direction of a surface; 

Fig. 10 is a flowchart showing the flow of image generation for 
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a 3D model; and 

Fig. 11 is a view showing an example of an image generated by 
the image generating method according to the present invention. 

Detailed Description 

Now, embodiments of the present invention will be described 
in detail referring to the drawings. 

First, will be described an entertainment apparatus according to 
the present invention. This entertainment apparatus executes an 
application such as a game provided from a storage medium such as a 
CD/ DVD or through a network. 

Fig, 1 is a block diagram showing a configuration of the 
entertainment apparatus according to the present invention. 

As shown in the figure, this entertainment apparatus comprises 
an MPU 100, a graphics processor (GP) 110, an I/O processor (IOP) 120, 
a CD/DVD decoder 130, an SPU 140, an OSROM 150, a main memory 
160, and an IOP memory 170. 

The MPU 100 and the graphics processor 110 are connected 
with each other through a bus 101. The MPU 100 and the IOP 120 are 
connected with each other through a bus 102. Further, the IOP 120, the 
CD/ DVD decoder 130, the SPU 140, and the OSROM 150 are connected 
with a bus 103, 

Further, the MPU 100 is connected with the main memory 160, 
and the IOP 120 is connected with the IOP memory 170. Further, the 
IOP 120 is connected with a controller (PAD) 180, 

The MPU 100 is a main CPU of this entertainment apparatus. 
The MPU 100 executes a program stored in the OSROM 150 or. a 
program loaded onto the main memory 160 from a CD or DVD, to 
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perform certain processing. 

The graphics processor 110 is an image generating processor 
that realizes the rendering function of the present entertainment 
apparatus. The graphics processor 110 performs image generation, on 
the instructions of the MPU 100, 

The IOP 120 is an input-output sub processor that controls data 
transmission and reception between the MPU 100 and a peripheral 
device (the CD/ DVD decoder 130, the SPU 140, or the like). 

The CD/DVD decoder 130 reads data from a CD or DVD 
mounted in a drive, and transfers the data to the main memory 160, 

The SPU 140 is a sound reproducing processor, and reproduces 
sound data (such as PCM data) stored in a sound buffer (not shown) at 
a predetermined sampling frequency, on a sound-producing instruction 
of the MPU 100. 

The OSROM 150 is a ROM that stores programs executed by the 
MPU 100 and IOP 120 at the time of the starting. 

The main memory 160 is the main memory for the MPU 100, 
and stores instructions executed by the MPU 100, data used by the MPU 
100, and the like. 

The IOP memory 170 is a main memory for the IOP 120, and 
stores instructions executed by the IOP 120, data used by the IOP 120, 
and the like. 

The controller (PAD) 180 is an interface for transmitting a 
player's intention to an application or the like during execution of a 
game or the like. 

Fig. 2 is a diagram showing internal structure of the graphics 
processor 110. As shown in the figure / the graphics processor 110 
comprises a host interface 200, an image generating function block 210, 
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a local memory 220, and a CRTC part 230. 

The Host interface 200 is an interface for transmitting and 
receiving data to and from the MPU 100. 

The image generating function block 210 is a logic circuit that 
5 performs rendering/ on the instructions of the MPU 100, The image 
generating fmictional block 210 comprises sixteen digital differential 
analyzers (DDA) and sixteen pixel engines, to parallelly process 16 
pieces (at maximum) of 64 bits pixel data (32 bits of color information 
and 32 bits of a Z value), The DDA calculates RGB values, a Z value, a 
10 texture value, etc* Based on such data, the pixel engine generates final 
pixel data. 

The local memory 220 stores pixel data generated by the image 
C generating function block 210, texture data transferred from the MPU 

m 100, and the like. 

jjt~ 15 The CRTC part 230 outputs contents of a frame buffer area in 

H b the local memory 220, as a picture signal of a designated output format 

jj (NTSC, PAL, VESA format, or the like). 

JL, Fig* 3 is a diagram showing structure of the local memory 220. 

fp As shown in the figure, the local memory 220 comprises the frame 

20 buffer area 250, a Z-buffer area 260, a texture buffer area 270, and a 
Q texture CLUT area 280, 

The frame' buffer area 250 and the Z-buffer area 260 are object 
areas for image generation in the meaning that the frame buffer area 
250 stores pixel data as a result of image generation, and the Z-buffer 
25 area 260 stores Z values as a result of the image generation, 

The texture buffer area 270 stores image data of texture, and the 
texture CLUT area 280 stores a color look-up table (CLUT) used when 
texture is an index color* 
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Here, the areas 250 - 280 can be freely arranged at any 
addresses in any order in the local memory 220, by setting suitable 
values into a prescribed control register. 

Next, will be described image generation of a 3D model that is 
performed by the entertainment apparatus having the above-described 
structure. An application performs image generation based on a 3D 
model that is stored in a CD/ DVD if necessary. In the following, 
description is given with respect to a case where the present invention 
is applied to a polygon model. However, the present invention can be 
applied just similarly to a spline model. 

In the following, is discussed a case where contours are 
displayed for a hexagonal prism shown in Fig. 4. As shown in the 
figure, the hexagonal prism 40 consists of six surfaces <D - ®. Here, 
for the sake of clarification, the figure shows contours of the polygon. 

Fig. 5 is a table showing an example of data structure of a 3D 
model as shown in Fig. 4. Fig. 5 shows data structure of a 3D model 
for a hexagonal prism having a diameter (width in the x-direction) 1 
and height 1. Here, it is assumed that the x-axis is directed toward the 
right in the figure, the y-axis is directed in the protruding direction 
from the figure, and the z-axis is directed upward in the figure. 

As shown in the figure, the 3D model data includes (x, y, z) 
coordinates of vertices of the surfaces © - © that constitute the 3D 
model, and (x, y, z) components of a normal vector at each vertex. 

Thus, generally, a 3D model is accompanied with normal 
(vector) information that indicates directions of the surfaces 
constituting the model. Here, Gouraud shading is employed as a 
method of shading. Accordingly, a normal existing at each vertex is 
an average of normals of the surfaces that abut the vertex in question. 
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Fig. 6 is a view showing a state of respective normal vectors at vertices 
of the hexagonal prism 40. 

When such a 3D model is to be displayed on a display screen, 
the MPU 100 transforms the coordinates of each vertex, based on the 
viewpoint or the like that corresponds to input from the controller 180, 
and instructs the graphics processor 110 to generate an image of each 
surface constituting the 3D model, while specifying color of each vertex, 
a shading method to be employed, and the like* 

Next, will be described the method of generating contours 
according to the present invention* The present method utilizes the 
normal information of the 3D model and surfaces facing the back side 
seen from a viewpoint, in order to display the contours. 

First, in the present method, the surfaces that face the back side 
seen from the viewpoint are shifted in the directions of their normal 
vectors, respectively. 

Fig. 7 is a view showing a state in which the surfaces facing the 
back side are shifted in the directions of their normals. As shown in 
the figure, in this example, the surfaces (D, <3>, and (5> are surfaces 
facing the back side, and those surfaces (D, ©, and ® are shifted in 
their normal directions. 

Then, the shifted surfaces are painted with a suitable color (for 
example, black). This generates display, just as if the contours of the 
model were drawn. When the surfaces to be shown like the counters 
are painted not with black but with a color that is darker to some 
degree (for example, about 50 %) than the color of the original surfaces 
to be shown, contours of soft coloring can be displayed, realizing soft 
presentation. 

Fig. S is a view showing a state in which the shifted surfaces are 
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painted with a darker color. In the present embodiment, hidden 
surfaces are removed by a rendering method using the Z-buffer. As a 
result the surfaces that are shifted in their normal directions and 
painted with the darker color are, in fact, painted only in their parts 
that extend out of the surfaces existing in the foreground. Thus, 
display is generated as if the contours were drawn on the screen. 

Further, since the present method generates the image 
according to the directions of the surfaces (directions of their normals), 
the widths of the contours depend on the directions of the surfaces. 

Fig. 9 is a view showing how thicknesses of the contours change 
according to the direction of a surface. As seen in the figure, Fig. 9A 
shows the thicker contours than Fig. 9B. Thus, thicknesses of the 
contours included in one object are not uniform. As a result, it is 
possible to generate lines of various thicknesses, looking like 
handwritten lines. 

Further, it is possible also to intentionally change thickness of 
contours, by multiplying values of normal vectors, which are used for 
shifting surfaces in the directions of their normals, by a predetermined 
coefficient. For example, multiplication by 2 makes the thicknesses of 
the contours twofold, and multiplication by 0.5 makes the thicknesses 
half. 

In other words, the present method can change coloring and 
thicknesses of contours by simple calculation, and thus, real-time 
control can be realized. 

The above-described techniques can be used in such a manner 
that, for example, a 3D model existing more distantly from the screen 
has thinner contours and has a color closer to the original surface color. 
As a result, it is possible to provide expression in which the more 
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distant a 3D model is, the more it matches the background, 

Fig. 10 is a flowchart showing the flow of the above-described 
image generation. This processing is executed by the MPU 100. 

First, one surface is selected as an object of image processing 
5 out of the surfaces constituting a 3D model as an object of image 
processing, and calculates a direction of that surface (S1000). 

Next, it is judged if the surface, i.e., the object of the image 
processing, faces toward the screen (viewpoint) or not (SI 002). 

As a result, when the surface as the object of the image 
10 processing faces toward the screen (S1002: YES), then, an instruction is 
given to the graphics processor 110 to simply generate an image of that 
surface (S1G04). 

On the other hand, when the surface as the object of the image 
processing faces in the opposite direction to the screen (S1002: NO), 

15 then, an instruction is given to the graphics processor 110 to simply 
generate an image of that surface (S1006), and, in addition, an 
instruction is given to the graphics processor 110 to generate an image 
of a surface used for displaying contours (S1008), Namely, 
instructions are given to the graphics processor 110 to generate a 

20 surface defined by vertices obtained by adding (normals X the 
thickness coefficient of the lines) to the vertices defining the surface as 
the present object of the image processing, and to paint the generated 
surface with a color obtained by (the color of the original surface X 
the color coefficient of the lines). 

25 Here, when ail (or almost of) 3D models have closed shapes (i.e., 

shapes whose inner surfaces can not be seen), the simple image 
generation processing S1006 of the surfaces facing backward can be 
omitted. 
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Performing the above-described processing for every surface 
constituting the 3D model, a resultant image having contours can be 
obtained. 

Fig, 11 is a view showing an example of an image generated by 
5 the present method of image generation. As shown in the figure, a 
character is displayed, being accompanied with contours, and thus, 
giving a display screen like a eel animation. 

According to the above-described method q£ image generation, 
every calculation can be performed for one surface at a time, without 
10 requiring consideration of another surface. Thus, a storage area for 
expressing correlation between surfaces is not necessary, and it is not 
required to check a relation between surfaces. Accordingly, the 
^ present method of image generation can realize high speed generation 

£0 of contours. 

^ 15 As described above in detail, the present invention can realize 

high speed display -as if accompanied by contours, Accordingly/ 
real-time three dimensional CG animation in a eel animation style can 

Ire, be realized, for example. 
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